Evaluation of Global Hierarchical Object Graphs for Coding Activities: a Controlled Experiment

A diagram of the runtime structure shows objects and their relations and complements diagrams of the code structure. One such diagram, the Ownership Object Graph (OOG), is a global object graph that conveys architectural hierarchy based on annotations in the code. In this work, we ask the research question: do developers benefit from using OOGs, in addition to class diagrams, during their coding activities? We conducted the first controlled experiment evaluating global object graphs in relation to class diagrams. We observed 10 developers, for 3 hours each, perform coding activities on a framework application. Developers struggled with many questions about the object structure. Two developers who used OOGs completed the three tasks compared to only one developer who used only class diagrams. Developers who used OOGs performed their activities in less time by 22–60%, and browsed less irrelevant code by 10–60%, compared to those who used only class diagrams. This technical report is based on: Ammar, N. Evaluation of the Usefulness of Diagrams of the Run-Time Structure for Coding Activities, M.S. thesis, Wayne State University, Department of Computer Science, August 2011. Available online: http://digitalcommons.wayne.edu/oa_theses/91/